Bayesian model selection using encompassing priors
نویسندگان
چکیده
منابع مشابه
Entropic Priors and Bayesian Model Selection
We demonstrate that the principle of maximum relative entropy (ME), used judiciously, can ease the specification of priors in model selection problems. The resulting effect is that models that make sharp predictions are disfavoured, weakening the usual Bayesian “Occam’s Razor”. This is illustrated with a simple example involving what Jaynes called a “sure thing” hypothesis. Jaynes’ resolution o...
متن کاملModel Selection in Bayesian Neural Networks via Horseshoe Priors
Bayesian Neural Networks (BNNs) have recently received increasing attention for their ability to provide well-calibrated posterior uncertainties. However, model selection—even choosing the number of nodes—remains an open question. In this work, we apply a horseshoe prior over node preactivations of a Bayesian neural network, which effectively turns off nodes that do not help explain the data. W...
متن کاملBenchmark Priors for Bayesian Model Averaging
In contrast to a posterior analysis given a particular sampling model, posterior model probabilities in the context of model uncertainty are typically rather sensitive to the specification of the prior. In particular, “diffuse” priors on model-specific parameters can lead to quite unexpected consequences. Here we focus on the practically relevant situation where we need to entertain a (large) n...
متن کاملChemical Identification using Bayesian Model Selection
Remote detection and identification of chemicals in a scene is a challenging problem. We introduce an approach that uses some of the image’s pixels to establish the background characteristics while other pixels represent the target for which we seek to identify all chemical species present. This leads to a generalized least squares problem in which we focus on “subset selection” to identify the...
متن کاملAdaptive Bayesian Procedures Using Random Series Priors
We consider a general class of prior distributions for nonparametric Bayesian estimation which uses finite random series with a random number of terms. A prior is constructed through distributions on the number of basis functions and the associated coefficients. We derive a general result on adaptive posterior contraction rates for all smoothness levels of the target function in the true model ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Statistica Neerlandica
سال: 2005
ISSN: 0039-0402,1467-9574
DOI: 10.1111/j.1467-9574.2005.00279.x